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Abstract 

In  this  paper,  we  provide  a  dynamic  graph  theoretical  framework  for  flocking  in  presence 
of  multiple  obstacles.  In  particular,  we  give  formal  definitions  of  nets  and  flocks  as  spatially 
induced  graphs.  We  provide  models  of  nets  and  flocks  and  discuss  the  realization/embedding 
issues  related  to  structural  nets  and  flocks.  This  allows  task  representation  and  execution  for  a 
network  of  agents  called  a-agents.  We  also  consider  flocking  in  the  presence  of  multiple  obstacles. 
This  task  is  achieved  by  introducing  two  other  types  of  agents  called  /3-agents  and  y-agents.  This 
framework  enables  us  to  address  split/rejoin  and  squeezing  maneuvers  for  nets/flocks  of  dynamic 
agents  that  communicate  with  each  other.  The  problems  arising  from  switching  topology  of  these 
networks  of  mobile  agents  make  the  analysis  and  design  of  the  decision-making  protocols  for  such 
networks  rather  challenging.  We  provide  simulation  results  that  demonstrate  the  effectiveness 
of  our  theoretical  and  computational  tools. 


1  Introduction 

A  special  behavior  of  large  number  of  interacting  dynamic  agents  called  “flocking”  has  attracted 
many  researchers  from  diverse  fields  of  scientific  and  engineering  disciplines.  The  term  “flocking” 
in  English  means  “moving  together  in  large  numbers”.  This  behavior  exists  in  the  nature  in  the 
form  of  flocking  of  birds,  schooling  of  fish,  and  swarming  of  bacteria  [19]. 

Reynolds  introduced  three  ad-hoc  protocols  for  autonomous  agents  moving  in  a  3-D  space 
called  “boids”  [17].  The  combination  of  these  three  protocols  led  to  creation  of  the  first  animation 
of  flocking  in  1987.  In  [17],  the  society  of  boids  is  viewed  as  a  distributed  system.  This  is  precisely 
the  point  of  view  in  the  present  paper.  No  analysis  of  the  proposed  protocols  or  definition  of 
flocking  is  given  in  [17].  Later,  the  work  of  Reynolds  motivated  a  group  of  scientists  to  simulate 
and  analyze  one  of  the  three  protocols  of  Reynolds  for  attitude  alignment  in  Vicsek  et  al.  [20] .  A 
similar  attitude  alignment  problem  was  recently  investigated  by  Jadbabaie  et  al.  [9].  That  work  is 
motivated  by  the  work  of  Vicsek  et  al. .  Similar  to  the  work  of  Vicsek  et  al. ,  in  [9] ,  no  connections 
are  established  between  the  first  two  flocking  protocols  of  Reynolds  and  the  connectivity  of  the 
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network  of  mobile  agents.  The  important  contribution  of  the  work  of  Jadbabaie  et  al.  is  that 
connectivity  in  all  times  is  not  needed  and  connectivity  of  the  network  on  average  is  sufficient  for 
alignment  of  the  agents.  In  Liu  et  al.  [10],  stability  analysis  of  swarms  with  fixed  interconnection 
topology  is  studied.  Furthermore,  Gazi  and  Passino  [6]  use  social  potentials  to  create  cohesion  in 
swarms. 

Obstacle  avoidance  for  single- vehicle  systems  has  a  long  history  in  robotics  [18].  This  is  certainly 
not  the  case  for  multi-vehicle  obstacle  avoidance.  Obstacle  avoidance  for  multi-agent  systems  using 
gyroscopic  forces  with  connections  to  flocking  is  recently  discussed  by  Chang  et  al.  in  [3].  This 
method  only  uses  local  information  and  relies  on  the  work  of  Chang  and  Marsden  [2],  The  use  of 
gyroscopic  forces  is  an  alternative  approach  to  obstacle  avoidance  using  centralized  constructions 
of  potential  functions  by  Rinron  and  Kodischek  in  [18]. 

In  this  paper,  our  main  goal  is  design  and  analysis  of  distributed  algorithms  (or  protocols)  for 
cooperative  decision-making  in  networks  of  mobile  agents.  Flocking  is  an  example  of  cooperative 
behavior  in  a  complex  system  that  is  formed  by  the  communication  and  interaction  among  large 
number  of  agents.  Flocking  in  presence  of  multiple  environmental  obstacles  or  adversarial  agents, 
leads  to  solving  decision-making  problems  in  networks  of  dynamic  agents  with  switching  topology 
[11].  Particularly,  this  is  the  case  in  missions  that  require  low-altitude  flight  of  unmanned  air 
vehicles  (UAVs).  Moreover,  in  a  competitive  team-on-team  game  with  two  teams  A  and  B,  some 
of  the  players  of  the  team  B  might  block  the  view  or  communication  between  the  members  of  team 
A.  In  this  work,  we  consider  flocking  in  presence  of  multiple  fixed  obstacles.  These  environmental 
obstacles  can  be  viewed  as  immobile  players  of  team  B.  The  role  of  the  obstacles  (or  players  of 
team  B )  is  to  break  the  communication  links  between  the  agents  in  a  flock  (i.e.  members  of  team 
A  called  a-agents). 

In  general,  groups  of  agents  that  move  in  large  numbers  might  not  be  able  to  pass  through 
tight  spaces  together  while  maintaining  safe  inter-agent  distances.  This  phenomenon  is  also  known 
as  “escape  panic”  [7].  Escape  panic  claims  the  lives  of  so  many  people  in  disasters  that  occur  in 
crowed  enclosed  places  with  few  exits  (see  [7]  and  Figure  8). 

The  main  contributions  of  this  work  is  to  introduce  a  theoretical  framework  for  flocking  with 
multiple  obstacle  avoidance  that  relies  on  a  combination  of  dynamical  systems,  mechanics,  and 
graph  theory.  In  particular,  formal  definitions  of  a  “ffock”  and  the  behavior  of  “ffocking”  are 
presented.  The  problem  of  performing  flocking  is  reduced  to  solving  two  separate  problems:  the 
structural  stabilization  of  a  flock  and  the  tracking  problem  for  the  flock  as  a  whole.  This  is 
formally  stated  as  a  flocking  separation  principle.  The  problem  of  flocking  in  presence  of  multiple 
obstacles  is  also  discussed.  The  solution  to  the  obstacle  avoidance  problem  uses  the  same  theoretical 
framework  as  structural  stabilization  of  flocks.  As  a  by-product,  we  manage  to  perform  split,  rejoin, 
and  squeezing  maneuvers  for  flocks  of  mobile  agents.  The  issues  regarding  solving  decision-making 
problems  with  limited  (or  local)  communication  in  a  network  with  switching  topology  are  discussed 
[11].  It  turns  out  that  a  number  of  open  problems  are  left  that  need  to  be  addressed  in  the  future. 

An  outline  of  the  paper  is  as  follows:  in  Section  2  nets  and  flocks  are  defined  as  spatially 
induced  graphs.  In  Section  3,  the  notion  of  structural  nets  are  introduced  as  less  restrictive  forms 
of  multi- agent  formation  graphs.  In  Section  4,  structural  energy  of  nets  and  flocks  is  defined  as 
the  Hamiltonian  of  a  dynamic  graph.  In  Section  5,  the  issues  regrading  the  differentiability  of 
structural  energy  of  nets  and  flocks  with  switching  topology  is  discussed.  In  Section  6,  two  types 
of  protocols  for  maintaining  a  given  distance  between  two  a-agents  are  given.  In  Section  7,  the 
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(a)  (b) 

Figure  1:  (a)  A  spherical  neighborhood  (or  shell)  and  (b)  a  conic  neighborhood. 

connections  between  Reynolds  three  rules  of  flocking  and  the  interaction  protocol  between  two 
a-agents  are  clarified.  In  Section  8,  the  results  on  flocking  using  dissipation  of  structural  energy 
of  nets  are  presented.  In  Section  9,  quasi-realization  of  nets  and  the  notion  of  the  defect  factor 
of  conformations  of  structural  nets  are  discussed.  A  separation  principle  for  flocking  is  given  in 
Section  10.  In  Section  11,  obstacle  avoidance  and  the  definition  and  behavior  of  (3  and  7  agents  are 
stated.  Finally,  in  Section  12,  concluding  remarks  are  made. 


2  Nets  and  Flocks:  Spatially  Induced  Graphs 

In  this  section,  we  use  several  basic  notions  from  graph  theory.  Further  information  on  graph  theory 
is  available  in  [1,  5,  8].  A  graph  is  denoted  by  G  =  (V,£)  with  V  as  the  set  of  nodes  and  £  as  the 
set  of  edges  of  the  graph.  The  order  of  graph  is  the  number  of  nodes  of  the  graph  n  =  |Gj  =  |V|. 
An  edge  is  denoted  by  ij .  ( i,j )  or  ( Vi,Vj )  with  i,j  G  N  as  the  node  indices  and  17,17  G  V. 

Let  qi  G  (e.g.  d  =  2,3)  with  i  G  N  denote  the  position  of  the  ith  node  17.  Define  q  = 
col((/j)  G  Wld  where  n  =  |V|  is  the  number  of  nodes.  A  spherical  neighborhood  (or  shell )  of  radius 
17  >  0  around  qi  is  defined  as 

B(qi,ri)  :=  {1  G  ld  :  \\x  -  qi\\  <  77}.  (1) 


Denote  r  =  col(rj).  We  refer  to  the  pair  (q,  r)  as  a  cluster  with  configuration  q  and  vector  of  radii 
r.  We  define  a  spatial  adjacency  matrix  A(q)  =  [ atj(q )]  induced  by  a  cluster  q  as  follows 


aij(q) 


1,  if  qj  G  B(qi,n),j  i 
0  otherwise. 


(2) 


The  spatial  adjacency  matrix  A(q)  defines  a  spatially  induced  graph  G(q).  We  call  G(q)  a  net , 
i.e.  a  net  is  a  graph  that  is  spatially  induced  by  a  cluster.  Figure  1(a)  shows  an  example  of  a  node 
with  a  spherical  neighborhood  and  the  set  of  neighbors  W  defined  as 


Ni  =  Nfiq)  :={j  :  alJ(q)  >  0} 


(3) 
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In  general,  a  net  is  a  directed  graph  (or  digraph).  This  is  because  if  rt  >  rj,  then  j  G  W  does  not 
necessarily  imply  i  G  Nj.  Notice  that  the  graph  G(q)  is  undirected  (i.e.  atj(q)  =  ajflq)  for  all  i,  j) 
for  all  q  if  and  only  if  r*  =  rj  for  all  i,j.  This  means  that  if  all  the  nodes  have  reached  an  agreement 
regarding  the  radius  of  their  shells,  then  the  induced  net  by  cluster  (q,  r)  with  r  =  (r, . . . ,  r)T  is  an 
undirected  net. 

If  rt  =  r  for  all  i,  we  denote  a  cluster  by  (q,  r)  and  call  it  a  uniform  cluster.  Furthermore,  the 
graph  G(q)  that  is  induced  by  a  uniform  cluster  is  called  a  uniform  net.  All  uniform  nets  that  are 
induced  by  clusters  with  spherical  neighborhoods  are  undirected.  However,  this  is  not  the  case  for 
clusters  with  conic  neighborhoods  as  shown  in  Figure  1(b). 

Consider  a  cluster  with  nodes  that  have  a  position  xt  G  R2  and  an  attitude  (or  heading  an¬ 
gle)  6t  G  R.  The  configuration  of  the  node  i  can  be  written  as  q-t  =  col G  R3.  A  conic 
neighborhood  of  node  i  is  defined  as 

C(xi,Oi,ri,<pi)  :=  {(x,0)  G  R2  x  R  :  \\x  -  Xi\\  <  r*,  1 9  -  0j|  <  ipi}.  (4) 


The  use  of  conic  neighborhoods  for  flocking  is  due  to  Reynolds  [17].  A  cluster  with  nodes  that  have 
conic  neighborhoods  can  be  represented  as  (q,  r,  (p)  where  r  =  col(rj)  and  (p  =  col((^j).  Similarly, 
a  uniform  cluster  with  conic  shells  is  represented  by  (q,  r,  <po)  where  jy  =  r  and  p>i  =  po  for  all  i. 
The  spatial  adjacency  matrix  for  a  uniform  cluster  with  conic  shells  can  be  written  as 


aij(q) 


1,  || xj  -  Xi ||  <  r,  | Oj  -  8i\  <  p0,j  /  % 

0  otherwise. 


(5) 


Remark  1.  In  general,  for  agents  with  configurations  ( Xi,Rj )  G  SE(d),  a  conic  region  in  M.d  ( d  >  2) 
can  be  defined  as 


Si  =  {(x,  R)  G  Rd  x  SO(d)  :  \\x  —  Xj||  <  p(R,  Ri)  <  Pi},  (6) 

where  0  <  p>i  <  2  and  p(R,  Ri)  =  \Trace(I  —  RT Rf)  is  a  distance-type  function  on  the  Lie  group 
SO{d). 

In  general,  a  uniform  net  induced  by  a  uniform  cluster  with  conic  shells  is  a  directed  graph. 
This  makes  the  motion  planning  analysis  related  to  nets/flocks  induced  by  clusters  with  conic  shells 
rather  challenging. 

Definition  1.  (flock)  A  flock  is  a  weakly  connected  net. 


Note  that  a  digraph  is  called  weakly  connected  if  there  exists  a  path  that  connects  any  two 
distinct  nodes  of  the  graph  irrespective  of  the  direction  of  the  edges  that  constitute  the  path,  i.e. 
for  any  two  nodes  i,j ,  i  j,  there  exists  a  set  of  indices  ii,  i 2, . . .  ,im  with  i\  =  i  and  im  =  j  that 
defines  a  path 

7T i,j  =  {  (fl  j  *2)  1  (*2>  *3)  j  ■  ■  •  j  (fm—  1 )  im) } 

such  that  for  all  k  G  {1, . . . ,  m  —  1},  £(G)  contains  (ikflk+i)  or  (ik+iflk)- 

Suppose  a  net  A f  =  G(q)  consists  of  m  weakly  connected  components,  then  M  contains  m  flocks 
Fi(q),  F2(q), ... ,  Fm(q).  We  refer  to  |A7|  (i.e.  the  order  of  a  net/graph)  as  the  population  of  a  net. 
The  density  of  a  net  is  defined  as  follows 


So  =  5o(AO  := 


maxfc  \Fk\ 

EZLi  1^1 


(7) 
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Apparently,  a  net  of  density  1  is  called  a  flock.  We  call  a  net  with  a  relatively  high  density  satisfying 
0  <  1  —  5q  <C  1  a  quasi-flock. 

Throughout  this  paper,  we  assume  that  all  the  nets  are  uniform.  For  a  uniform  net,  the  elements 
of  the  adjacency  matrix  A(q)  can  be  rewritten  as 


aij(q) 


1,  hj  -  <li\\<r,j  fli 

0  otherwise. 


(8) 


Note  that  au(q)  =  0.  Let  us  define  the  in-degree  and  out-degree  of  node  Vi  as 

degin(ui)  =  T.jeNi  aji  =  ajM) 
deg outivi)  =  V;.  xfl'ij  yij«ij(q) 

The  spatial  degree  matrix  A (q)  =  [At](q)\  is  diagonal  matrix  with  diagonal  elements 

Au(q)  =  deg  out{q) 

The  spatial  Laplacian  matrix  L(q )  of  the  net  G(q)  is  defined  as 


(9) 


(10) 


L(q)  =  A(q)  -  A(q)  (11) 

In  general,  if  q(t)  changes  in  time,  both  the  net  G(q(t))  and  its  Laplacian  L(q(t))  (possibly)  change 
in  time.  This  creates  a  network  with  switching  topology  [15].  We  call  a  net  (or  graph)  balanced  if 
and  only  if  deg in{vi)  =  deg out(vi)  for  all  nodes  Vi  £  V.  Let  1  =  (1, 1, . . . ,  1)  £  Mn,  then  the  following 
result  summarizes  the  properties  of  a  balanced  net  G(q). 

Proposition  1.  Let  Af  =  G(q)  be  a  directed  net.  Then,  the  following  properties  hold: 

i)  If  Af  is  uniform,  then  Af  is  a  balanced  net. 

ii)  Af  =  G(q)  is  balanced  if  and  only  if  1T L(q)  =  0  for  all  clusters  (q,  r). 


Proof.  All  uniform  nets  are  undirected  and  all  undirected  graphs  are  balanced.  This  proves  part 
i).  The  condition  1T L(q)  =  0  means  that  the  column  sum  of  L(q)  is  zero  for  all  columns.  On  the 
other  hand,  the  ith  column  sum  of  L(q)  is  equal  to  degin(vi)  —  degout(vi).  Thus,  1  TL(q)  =  0  if  and 
only  if  degin(vi)  —  degouf(t>j)0  for  all  nodes  Uj,  i.e.  G(q)  is  balanced.  □ 

The  result  in  Proposition  1  can  be  used  for  attitude  alignment  in  a  flock  of  agents  or  any  other 
consensus  problem  for  agents  with  dynamics 


Qi  =  <Ji  (12) 

using  the  agreement  protocol 

UH=  (13) 

j&Ni{q) 

with  nonsmooth  (or  smooth)  adjacency  matrix  A(q).  Further  information  on  agreement  in  networks 
with  switching  information  flow  is  available  in  [15]. 
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Figure  2:  (a)  A  bump  function  p(z)  and  (b)  p'(z). 


Now,  we  show  that  even  for  a  small  net  with  n  =  2  nodes,  the  graph  Laplacian  L(q)  is  a 
discontinuous  function  of  q  for  nets.  The  following  two  adjacency  matrices 


A,  = 


0  0 
0  0 


a2 


0  1 
1  0 


(14) 


correspond  to  the  cases  where  a\2 
A\  and  A2  are  given  by 

Li 


0  and  ai2  =  1,  respectively.  The  Laplacians  associated  with 


0  0 
0  0 


L2 


1  -1 

-1  1 


(15) 


Clearly,  all  four  elements  of  L(q )  are  discontinuous  functions  of  q  and  the  jumps  occur  at  points  q 
satisfying 

||<?2  -  9i||  =  r. 


This  is  certainly  not  a  problem  if  one  does  not  try  to  differentiate  L(q(t))  as  a  function  of  time. 

In  the  following,  we  explain  a  smoothing  process  for  L(q).  Consider  a  smooth  bump  function 
p(z)  :  M  — >  [0, 1]  satisfying  the  following  properties: 


P(z) 


1,  z  <  k  o 

0,  z>l,  p'(z) 

G  (0, 1)  otherwise. 


dp{z) 

dz 


0,  z  <  ko 

0,  z>l 

<  0  otherwise. 


(16) 


where  0  <  k^  <  1.  We  assume  that  all  the  bump  functions  in  this  work  satisfy  |//(2:)|  <  Lp  (i.e. 
have  uniformly  bounded  derivative).  An  example  of  a  bump  function  p(z/r)  with  ko  =  |  and 
r  =  12  is  shown  in  Figure  2.  Clearly,  for  all  z  <  kor,  p(z)  =  p{z/r )  =  1. 

For  a  uniform  cluster  (q,r)  with  spherical  shells  a  smooth  adjacency  matrix  A(q)  =  [atj(q)\  by 
its  elements 

aij(q)  ■■=  P(hj  ~  qi\\/r)  (17) 
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Similarly,  for  a  uniform  cluster  (q,  r,  c po )  with  conic  shells,  the  elements  of  the  adjacency  matrix  of 
the  directed  net  G(q)  are  defined  as 


aij{q)  ■=  p(\\xj  -  Xi\\/r)p(\0j  -  di\/(p0) 


(18) 


Thus,  for  a  cluster  of  n 
this  net  is  given  by 


2  nodes  with  spherical  shells,  a  smooth  Laplacian  of  the  net  induced  by 


L(q)  =  p(H  -  Qi IIA) 


(19) 


The  following  lemma  guarantees  that  the  calculations  needed  for  applying  the  protocols  pre¬ 
sented  in  this  paper  can  be  performed  in  a  distributed  manner. 


Lemma  1.  For  all  the  nodes  j  0  Nt  that  are  not  among  the  neighbors  of  node  i,  aij(q)  =  0  and 

Vaij(q)  =  0. 

Proof.  By  direct  calculation.  □ 


3  Structural  Nets/Flocks  and  their  Realizations 

Let  us  refer  to  all  the  nodes  of  a  net/flock  as  a-agents.  Roughly  speaking,  the  objective  of  an 
a-agent  is  to  maintain  a  distance  dQ  between  itself  and  another  a-agent  provided  that  0  <  da  <  r. 
In  the  presence  of  obstacles,  an  a-agent  tries  to  avoid  collision  to  the  obstacles  and  meanwhile 
try  to  maintain  a  distance  da  between  itself  and  other  neighboring  a-agents.  However,  in  many 
situations  including  split/rejoin  maneuver  and  squeezing  maneuver  these  two  objectives  of  an  a- 
agent  are  conflicting  goals.  Thus,  an  a-agent  needs  to  prioritize  the  tasks  assigned  to  it  and  give 
the  highest  priority  to  avoiding  collision  to  obstacles.  Later,  we  formalize  what  we  mean  by  task 
prioritization.  First,  we  assume  that  temporarily  there  are  no  obstacles  and  formalize  the  task  of 
keeping  a  distance  da  from  other  neighboring  a-agents. 

Remark  2.  For  future  use,  we  need  to  distinguish  between  the  agents  in  a  net  and  other  types  of 
agents  that  are  due  to  the  presence  of  obstacles  or  adversarial  agents  in  an  environment. 

A  net  G(q)  of  a-agents  is  called  an  a-net.  We  refer  to  the  pair  (da,r)  with  fco  =  da/r  <  1  as  an 
indefinite  structural  a-net.  A  definite  structural  a-net  is  a  triplet  (n,da,r)  where  n  in  an  integer. 

Note  1.  Let  (q,r)  be  a  uniform  cluster.  By  calling  G(q)  a  “net”,  we  mean  both  G(q)  as  a  “graph” 
G  =  (' V,£ )  =  G(q)  and  G(q)  as  a  “framework”  (G,q)  (i.e.  a  graph  together  with  the  coordinates  of 
its  nodes)  whichever  makes  sense  in  the  context. 

We  say  a  net  G(q)  is  a  realization  (or  embedding )  of  the  indefinite  structural  net  ( da,r )  in  M2 
if  and  only  if  the  following  condition  is  satisfied 

\\qj  ~  qi\\  =  da,Vj  G  Ni  (20) 

for  all  the  a-agents  w,  £  V.  Furthermore,  if  G(q)  is  a  net  with  n  nodes,  then  G(q)  is  referred  to  as 
a  realization  (or  embedding)  of  a  definite  structural  net  ( n,da,r ). 

It  is  rather  trivial  to  provide  a  realization  of  a  definite  (or  an  indefinite)  structural  net.  A 
polygon  with  n  vertices  and  equilateral  sides  of  length  dQ  specifies  a  cluster  that  induces  a  cycle  of 
length  n  as  a  (generic)  realization  of  a  definite  structural  net  (■ n,da,r ). 
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(d)  (e)  (f) 


Figure  3:  Different  realizations  of  a  definite  structural  a-net  ( n,da,r )  with  n  =  4  nodes  satisfying 
da  <  r  <  \/2d:(a)  an  a-net  (or  quasi  a-flock)  with  density  Sq  =  (b)  a  quasi  a-flock  with 

density  do  =  f  consisting  of  two  flocks,  (c)  an  a-flock  with  4  edges,  (d)  a  chained-form  a-flock  or 
conformation  with  3  edges,  (e)  a  rigid  conformation  with  5  edges,  and  (f)  a  rigid  a-flock  with  5 
edges  (but  different  set  of  edges  than  part  (e)). 

Let  ( q ,  r)  be  a  uniform  cluster  that  is  obtained  from  cluster  (g,  r)  via  permutation  of  the  2 
blocks  of  q.  We  call  Af  =  G(q)  a  permutation  of  the  net  Af  =  G(q). 

Lemma  2.  Let  ( n,da,r )  be  a  structural  net  with  realization  Af  =  G(q).  Then,  any  permutation  Af 
of  Af  is  also  a  realization  of  (n,dQ,r). 

Proof.  The  proof  follows  from  the  definition.  □ 

Following  the  result  of  Lemma  2,  let  [G(g)]  denote  the  similarity  class  of  all  graphs  that  are 
obtained  via  permutation  of  the  nodes  of  G(q).  We  call  [G(g)]  a  conformation  of  the  structural  net 
(n,da,r). 

Note  2.  All  the  properties  and  names  of  a  net  is  carried  over  to  a  flock  if  the  net  is  weakly 
connected.  For  example,  an  a-flock  is  a  weakly  connected  a-net. 

Example  1.  In  Figure  3,  six  different  realizations  of  a  structural  a-net  (n,  da,  r)  with  n  =  4  nodes 
satisfying  the  condition  1  <  r/da  <  \f2  are  shown.  In  Figure  3(a),  all  nodes  are  mutually  too  far 
from  each  other  to  form  links  (i.e.  undirected  edges).  In  Figure  3(b),  two  pairs  of  nodes  (1,2)  and 
(3,4)  are  close  enough  to  form  links  but  the  end  points  of  these  two  links  are  too  far  from  each 
other.  In  Figure  3(c),  a  cycle  is  formed  via  the  4  links.  However,  since  the  distance  between  the 
pairs  of  nodes  (1,4)  and  (2,3)  is  equal  to  da  >  r,  no  links  are  formed  between  these  two  pairs. 
In  Figure  3(d)  a  chain  (i.e.  a  path  of  length  n  going  through  all  nodes)  is  shown  as  the  realization 
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of  ( n,da,r ).  All  the  nodes  that  are  not  connected  in  this  chain  are  at  least  2 da  >  r  apart  from 
each  other.  Figure  3(e)  shows  a  flexing  of  the  non-rigid  framework  in  Figure  3(c)  where  nodes  1 
and  4  get  close  enough  to  each  other  to  form  a  link  (see  [14]  for  the  definition  of  a  flexing  and  graph 
rigidity).  Similarly,  Figure  3(f)  shows  another  flexing  of  the  non-rigid  framework  in  Figure  3(c)  so 
that  nodes  2  and  3  get  closer  to  each  other  and  form  a  link.  Both  realizations  in  Figures  3(e)  and 
(f)  belong  to  the  same  conformation  of  this  structural  net. 

From  Figure  3,  it  is  evident  that  the  generic  realizations  (or  conformations)  of  structural  nets 
are  not  unique.  This  is  the  opposite  of  the  local  uniqueness  property  of  the  realizations  of  rigid 
structured  graphs  [14].  Here  is  a  problem  for  researchers  interested  in  combinatorics: 

Problem  1.  Calculate  f(n ,  k),  the  number  of  conformations  of  a  definite  structural  a-net  ( n ,  da,  r) 
with  r  =  kda  for  n  >  2  and  k  >  1. 

n(n—  1) 

Lemma  3.  f{n,k)  <  2  2  where  f(n,k)  is  defined  in  Problem  1. 

Proof.  Let  [Gr(g)]  be  a  conformation  of  the  structural  net  in  the  question.  In  general,  [G'(g)]  has 
a  subset  of  the  edges  of  a  complete  graph  on  n  nodes.  □ 

Remark  3.  One  can  show  that  for  1  <  k  <  y/2,  f{n,k)  takes  the  following  values  1,2,4, 9,  respec- 

n(n  —  1) 

tively,  for  n  =  1,2,  3, 4.  Clearly,  2  2  is  a  conservative  upper  bound  on  f(n,k)  which  is  by  no 

means  tight  for  n  >  2. 

4  Structural  Energy  of  Nets  and  Flocks 

Consider  a-agents  with  the  following  dynamics 

agent  dynamics:  <  (21) 

(  Pi  =  . 

Let  us  define  the  position/ velocity  of  an  a-net  as  the  average  position/velocity  of  all  the  a- agents 
in  the  net,  i.e. 

q  =  Ave(q ),  p  =  Ave(p )  (22) 

with  Ave{x)  :=  ^L(f^i=\xi)-  Defining  u  =  Ave(u),  the  translational  dynamics  of  the  net  can  be 
expressed  as 

|  Q  —  f) 

translational  dynamics:  <  ^  (23) 

with  q,p,u  €  M2.  Let  1  =  (1, . . . ,  1)T  £  Mn  denote  the  vector  of  ones  and  <g>  denote  the  Kronecker 
product  of  two  matrices  defined  by 

A®  B  =  [ aijB ]. 

This  means  the  ij th  block  of  A  <g>  B  is  a^B.  Define  the  relative  position,  velocity,  and  control  of 
agent  i  as 

qi  =  q%-  q,  Pi  =Pi~P,  Ui  =  Ui  -u  Mi  (24) 
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Figure  4:  The  potential  and  action  functions  with  parameters  a  =  1  and  6  =  5:  (a)  ipa(z)  and  (b) 
(t>a{z). 


Then,  one  can  write 

q  =  q  -  1  (8>  q, 
p  =  p  —  1  <g>  p, 
u  =  u  —  1  <g>  u, 

and  define  the  relative  dynamics  of  the  net  as 

f  q  =  p, 

\  p  =  u. 

Following  the  general  idea  of  construction  of  potential/cost  functions  for  formation  graphs  in  [13, 
14],  we  define  the  following  Hamiltonian  as  the  structural  energy  of  an  a- net  (or  a- flock): 

Hs(q,p)  =  V(q)  +  Kr(p)  (27) 


(25) 

(26) 


where  potential  energy  V(q )  and  relative  kinetic  energy  Kr(p )  of  the  a-net  are  defined  as  the 
following 


V(q)  =  Vi(q), 

Vi(q)  =  EieAr.  V'adki  -  Qi\\  -  da),  (28) 

Kr(p)  =  IEI Lilian2- 


The  potential  and  action  functions  ipa{z)  and  4>a(z)  are  defined  as  follows 


ipaiz) 

(fa(z) 


(^)(Vl  +  (,  +  c)2 

(a±b\  Z  +  C 

[  2  VT+lJ+cf 


-Vi+~c J)  +  (^) 

+  (¥). 


(29) 


where  b  >  a  >  0  and  c  =  \a  —  b\/2y/ab  >  0.  Notice  that  4>a(z)  =  difa(z)/dz  is  a  uniformly  bounded 
sigmoidal  function.  These  functions  are  plotted  in  Figure  4.  If  a  node  has  no  neighbors,  or  Ni  =  0, 
we  set  Vi(q )  :=  0. 

The  following  result  shows  that  reducing  Hs(q,p )  to  zero  is  meaningful  for  the  purpose  of 
“flocking”  (i.e.  “to  gather  or  move  in  large  numbers”  Longman  Dictionary). 
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Proposition  2.  (zero  structural  energy)  Given  the  definition  of  the  structural  energy  Hs(q,p)  of  a 
net  in  (27),  the  following  statements  hold: 

i)  V{q)  =0  if  and  only  if  the  net  G(q)  is  a  realization  of  the  structural  net  (da,r). 

ii)  If  Kr(p)  =  0  for  all  t  >  to,  then  the  distance  between  any  two  a-agents  remains  constant  for 
all  t  >  to-  Moreover,  the  converse  holds  if  a)  the  net  is  an  undirected  flock,  b)  no  two  agents 
ever  collide,  and  c)  there  exists  no  two  agents  with  different  velocities  such  that  pj  —  pi  is 
orthogonal  to  qj  — 

in)  If  Kr(p )  =  0  for  all  t  >  to,  then  the  topology  of  the  net  G(q(t))  remains  invariant  for  all 
t  >  to- 


Proof.  Please,  see  Section  A.l  in  the  Appendix.  □ 

We  summarize  the  results  of  Proposition  2  in  the  following: 

Proposition  3.  (zero  structural  energy)  Suppose  that  the  structural  energy  Hs(q(t),p(t))  is  zero 
for  all  t  >  to-  Then,  the  following  statements  holds: 

i)  the  net  G(q(t))  has  an  invariant  topology  over  [fo,oo)  that  is  a  realization  of  the  structural  net 
( da,r ). 

ii)  the  distance  between  any  two  arbitrary  a-agents  in  the  a-net  remains  constant  for  all  t  >  to- 
in)  the  velocity  of  all  a-agents  are  equal. 

Proof.  Parts  i)  and  ii)  follow  from  Proposition  2.  Part  iii)  is  due  to  the  fact  that  Hs(q,p )  => 
Kr(p )  =  0  =>■  pi  =  0  for  all  i.  Thus,  Pi  =  p  for  all  i  and  the  velocities  of  all  nodes  are  equal.  □ 
Motivated  by  Proposition  3,  we  define  “flocking”  as  follows. 

Definition  2.  (flocking)  Given  the  protocol  u  =  k(q,p),  we  say  a  dynamic  net  ( G(q),q,p,u )  is 
structurally  asymptotically  stable  if  and  only  if  both  of  the  following  conditions  hold: 

i)  There  exists  a  constant  C  >  0  such  that  Hs(q(t),p(t))  <  C  for  all  t  >  0. 

ii)  lirn^oo  Hs(q(t)1p(t))  =  0,  i.e.  for  all  e  >  0,  there  exits  T  =  T(e)  >  0  such  that 

Hs(q(t),p(t))  <  e 


for  all  t  >  T. 


5  Smooth  and  Nonsmooth  Structural  Energies 

In  general,  for  nets  with  nonsnrooth  spatial  adjacency  matrices  A(q),  the  Hamiltonian  Hs{q,p )  is  a 
discontinuous  function  of  ( q,p ).  The  Hamiltonian  associated  with  an  a-net  G(q)  can  be  expressed 
as 

1  n 

Hs{q,P )  =  aiM)^a(\\qj  ~  <7;||  ~da)  +  ~Y  WPiW 2  (3°) 

i=  1 


ii 
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Figure  5:  The  pair- wise  potential  function  between  two  a-agents:  (a)  the  nonsmooth  potential  and 
(b)  the  smooth  potential. 


Suppose  that  a  link  {(*,  j),  (j.  *)}  is  created  in  a  net  and  no  other  links  are  created  or  lost.  Then, 
there  will  be  a  positive  jump  in  the  energy  before  and  after  the  creation  of  this  link  that  is  given 

by 

A Hs  =  H+{q,p)  -  H~(q,p )  =  V+(q )  -  V~ (q)  =  ^ a(r  -  da)  =:  h0  >  0  (31) 

where  H±(q,p)  denotes  H(q(t),p(t)) \t=t±  and  \\qj{to)  —  gj(to)||  =  r,  i.e.  the  link  is  created  at  time 
t  =  to-  Similarly,  V±(q)  =  V(q(t±)).  The  loss  of  a  link  {(«,  j),  (j,  i)}  causes  a  negative  jump  in 
energy  that  is  equal  to  the  constant  ho  >  0.  This  is  not  the  case  for  a  net  with  a  smooth  adjacency 
matrix  A(q)  =  [ aij(q )]  where  a^(g)  =  p(\\qj  -  g*||/r ). 

Example  2.  The  potential  function  of  a  net  with  two  a-agents  is  shown  in  Figure  5(a).  For  two 
agents,  the  potential  function  takes  the  form 

V(q)  =  a12{q)'i/ja(\\q2  —  <7i  ||  —  dQ).  (32) 

Define  a  scalar  edge  deviation  variable 

V  =  \\Q2  ~  qi\\  ~  da  (33) 

and  consider  the  potential  energy  as  a  function  of  77.  The  condition  \\q2  —  gi||  <  r  reduces  to 
r]  <  r  —  da.  Figure  5(a)  shows  the  plot  of  the  potential  between  a  pair  of  a-agents  as  a  function 
of  77.  The  choice  of  parameters  are  da  =  10,  r  =  1.2 da,  a  =  1,  b  =  5,  and  c  =  \a  —  b\/2y/ab. 
The  discontinuous  jump  occurs  at  77  =  r  —  da  =  2.  Later,  we  explain  the  smoothing  process  of  a 
nonsmooth  potential  function  to  obtain  differentiable  pair-wise  potentials  as  shown  in  Figure  5(b). 

6  Protocol  for  (a,  a)  Interactions 

A  dynamic  net  is  a  net  in  which  each  node  is  a  dynamical  system.  Consider  the  following  (a,  a) 
protocol  for  the  interaction  between  an  a-agent  and  all  of  its  neighboring  a-agents  (i.e.  an  (a,  a) 
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interaction)  in  a  dynamic  a-net  with  a  nonsmooth  adjacency  matrix  A(q): 

u(a,a.l)  =  ^2  0Q(|| qj  -  Ql\\  -  da)nij  +  Cl(pj  -  Pi ),  Cl  >  0  (34) 

j&Ni 

where  n^-  =  ( qj  —  qi)/\\qj  —  (7*11  is  a  unit  vector  along  the  line  connecting  node  i  to  node  j. 

Remark  4.  Protocol  (34)  is  very  similar  to  the  protocol  given  by  the  author(s)  in  [13]  with  a 
minor  difference  in  the  damping  terms  and  the  fact  that  all  distances  in  a  rigid  formation  are  not 
necessarily  equal. 

For  a  dynamic  a-net  with  a  smooth  adjacency  matrix  -4(<7),  the  protocol  for  an  (a,  a)  interaction 
is  as  follows 

uf'a'2)  =  22  K?(<?)0a(lkj  -  qi II  -  da )  +  - :p{^Qj  q^)^a{\ \qj  -  qi\\  -  da)]nij  +  Ci(pj  - Pi )  (35) 

jeNi  r  r 

Consider  an  approximation  of  protocol  (35)  given  by 

u2a:2)  =  22  “b'W'MIl qj  -  qi\\  -  da)nij  +  Cl (Pj  -  Pi )  (36) 

j&Ni 

which  is  the  same  as  protocol  (34)  as  ko  — >  1“  for  the  bump  function  p(z).  Then,  assuming 
||p/(-2:)||  <  Lp ,  uniformly  in  z,  the  approximation  error  can  be  bounded  as  follows 

EH  (a, o,2)  -(a, o,2)  n  .  2Lp 

ll«i  -«i  II  <—rv(q)-  (37) 

i= 1 

Thus,  the  approximation  error  remains  relatively  small  if  the  net  has  a  relatively  low  structural 
potential. 


7  Reynolds  Rules  of  Flocking  and  the  (a,  a )  Protocol 


According  to  the  first  two  protocols  of  Reynolds  in  [17],  an  agent  moves  towards  the  center  of  mass 
(CM)  of  its  nearest  neighbors  if  it  is  too  far  from  them  and  avoids  going  towards  the  CM  of  its 
nearest  neighbors  if  it  is  getting  too  close  to  them.  In  the  following,  we  show  that  both  of  these 
rules  follow  as  special  cases  of  protocol  (34)  with  c\  =  0.  Moreover,  there  is  a  special  case  that  has 
not  been  accounted  for  by  any  of  the  three  flocking  rules  of  Reynolds  in  [17].  Finally,  the  third  rule 
of  Reynolds  for  attitude  alignment  is  the  same  as  a  consensus  protocol  given  in  equation  (13)  (for 
more  information,  please  see  [16]). 

Let  us  define  the  weights  between  agent  i  and  its  neighbors  j  E  Nt  as 


mj(q) 


<MI Wj  ~  Qj II  ~  da) 
I \Qj  ~  Qi\\ 


j^Ni 


(38) 


with  the  property  that  Wij(q)  >  0,  if  agents  i  and  j  are  more  than  dQ  apart,  and  Wij(q)  <  0 
otherwise.  Particularly,  if  these  two  agents  get  too  close  to  each  other  (or  e  =  \\q3  —  r/,;||  <C  1)  agent 
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i  gets  pushed  away  by  agent  j  with  a  force  proportional  to  4>a(da  —  || qj  —  %!!)  ~  4>a(da)  S>  1  along 
rijj.  Let  us  rewrite  the  approximate  rq-a,a,1')  with  zero  damping  terms  (or  c\  =  0)  as 


Ui 


22  Wij{q){qj  -  Qi )  =  22  WiM)qj  -  (22  Wi^qi 

j£Ni  j£Ni  j£Ni 


(39) 


Set  Si(q)  =  J2jeNi  wij(q)  and  define  the  vector  of  weighted  average  of  the  position  of  the  neighbors 
of  agent  i  as 


m  [2,w,Mqi 


(40) 


whenever  Si(q)  ^  0.  We  call  Si(q )  the  neighbors  vote  which  quantifies  how  all  spatial  neighbors  of 
agents  i  “think”  whether  agent  i  is  close,  far  or  neutral  with  respect  to  its  neighbors.  There  are 
three  possible  cases: 


i)  Si(q)  >  0:  In  this  case  the  neighbors  vote  is  positive  and 


iH  =  Si(q)(q?ve  -  ®)  cx  ( qr  ~  ®) 


(41) 


implies  that  agent  i  moves  towards  qfve  (because  Si(q)  >  0). 

ii)  Si(q)  <  0:  In  this  case  the  neighbors  vote  is  negative  (or  the  neighbors  all  think  that  agent  i 
is  far  from  them).  Based  on 


Ui  =  Si(q)(qre-qi)cx-(^-qi) 


(42) 


we  conclude  that  in  this  case  agent  i  moves  away  from  qfve. 

iii)  Si(q)  =  0:  In  this  case  the  neighbors  total  vote  is  zero,  i.e.  the  neighbors  are  divided  into 
three  groups:  a)  neighbors  N+  =  {j  e  TV*  :  Wij(q)  >  0}  whose  votes  are  positive  and  their 
total  vote  adds  up  to  (q)  =  Wij(q),  b)  neighbors  N~  =  {j  e  Nt  :  Wij(q)  >  0}  whose 

votes  are  negative  and  their  total  vote  adds  up  to  S~(q)  =  N-  u>ij(q),  and  c)  neighbors 
N f  =  {j  €  Ni  :  Wij(q)  =  0}  whose  votes  are  zero  (i.e.  they  are  exactly  da  away  from  agent 
i)  and  their  total  vote  adds  up  to  zero,  because  of  Sf(q)  =  JTgJvo  wij(q)  =  0-  Notice  that 
Sijf(q)  =  —S+(q)  due  to  Si(q)  =  Sf(q)  +  Sf(q')  +  S(+  (q)  =  0.  Let  us  define  the  following  two 
weighted  average  quantities 


<1 


ave(-\~) 


1 

sfW) 


22  wiM)<n 

\jeNf 


qi 


(-) 


1 

Sf(9) 


22  wMqj 

VieTV- 


(43) 


In  this  case,  we  get 

»i  =  S+(9)(5,a“<+)-gj)+Sr(9)(?““(_)-gi) 

=  s+(, )[(<r<+>  -«)-  ((!rw-«)]  <44> 

=  s+(,K«r(+)  -  «rH) 
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which  means 


~  /  ave(+ )  ave{—)\  /  ,r\ 

Ui  OC  (g.  v  ;  -  qi  y  ’).  (45) 

Thus,  the  protocol  for  case  iii)  is  as  follows:  agent  i  ignores  all  agents  that  had  neutral  (or 
zero)  votes  and  moves  parallel  to  —  q*ve^  \  i.e.  the  difference  between  the  weighted 

averages  of  all  who  voted  positive  and  all  who  voted  negative.  For  the  case  that  there  are 
two  groups  that  have  voted  equally  in  opposite  directions,  surprisingly,  protocol  (45)  cannot 
be  obtained  from  any  of  the  three  flocking  rules  of  Reynolds  in  [17]. 

In  conclusion,  the  first  two  flocking  rules  of  Reynolds  are  ‘Ridden”  in  the  (cc,  a)  protocol  in  (34). 
Note  that  there  is  a  “minor  glitch”  in  Reynolds  rules  where  the  damping  terms  do  not  exist  (due 
to  ci  =  0).  The  third  flocking  rule  of  Reynolds  for  alignment  is  the  same  as  a  linear  consensus 
protocol  with  no  time-delay  [15,  16]. 

8  Flocking  by  Dissipation  of  Structural  Energy 

Here  are  two  results  on  dissipation  of  nonsmooth  and  smooth  structural  energy  of  nets  for  the 
purpose  of  flocking: 

Proposition  4.  Consider  a  uniform  a-net  with  protocol  (34).  Let  to,ti,t2,  ■  ■  ■  be  an  increasing 
sequence  of  switching  times  of  the  topology  of  the  net  G(q(t))  over  the  interval  [io,oo)  so  that  at 
t.  =  tk- |-i,  k  >  0  at  least  one  link  is  created  or  lost  in  the  undirected  net  G &  =  G(q(tfi)).  Let  Hgk\q,p) 
be  the  structural  energy  of  the  net  Gk  with  discontinuous  adjacency  elements  atj(q )  £  {0, 1}.  Then, 
Hs k\q,fi)  is  a  weak  Lyapunov  function  for  the  closed-loop  net  dynamics  over  the  interval  [tk,tk+ l), 
i.e.  Hik\q,p)  <  0  for  all  t  £  [tkflk+i)-  Moreover,  if  the  switching  sequence  to,t\, ,...  ,tm  is  finite 
and  G(q(tm))  is  a  flock,  then  asymptotically  all  a-agents  asymptotically  move  with  the  same  velocity 
and  their  inter-agent  distances  are  preserved. 

Proof.  Please,  see  Section  A. 2  in  the  Appendix.  □ 

Remark  5.  At  this  point,  the  authors  are  unaware  of  the  quantitative  sufficient  conditions  that 
guarantee  the  switching  time  sequence  in  Proposition  4  remains  finite.  Our  observation  from 
experimental  results  demonstrates  that  under  the  conditions  in  Proposition  4,  the  switching  time 
sequence  is  always  finite  due  to  the  fact  that  (q(tk),p(tk ))  is  a  decreasing  sequence.  The 

complete  analysis  of  this  case  including  finding  appropriate  conditions  that  guarantee  the  finiteness 
of  the  switching  times  is  the  subject  of  ongoing  research. 

Proposition  5.  Consider  an  a-net  with  a  smooth  structural  energy  Hs(q,p).  Given  the  protocol 
in  (35),  Hs(q,p)  is  a  weak  Lyapunov  function  for  the  closed-loop  net  dynamics,  i.e.  H(q,p)  <  0 
for  all  t  >  t.Q.  Furthermore,  if  there  exists  a  time  T  >  to  such  that  the  net  G(q(t))  is  a  flock  for 
all  t  >  T,  then  asymptotically  all  the  a-agents  move  with  the  same  velocity  and  their  inter-agent 
distances  are  preserved. 

Proof.  The  proof  is  rather  similar  to  the  proof  of  Proposition  4  and  will  not  be  repeated.  Based 
on  protocol  (35),  we  have 

Hs(q,p)  =  -j  Y  WPj-Pif 

{i,j)e£a(q) 
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If  the  graph  (or  net)  G(q(t ))  induced  by  (q(t),r)  is  connected  for  all  t  >  T.  Then,  pj  =  pi ,  for 
all  the  edges  (i.  j)  of  the  net  G(q(t)).  This  implies  pi  =  0  for  all  i.  Therefore,  asymptotically  all 
a-agents  move  with  equal  velocities  and  the  inter-agent  distances  are  preserved.  □ 

9  Quasi-Realizations  and  Defect  Factors 

We  define  the  defect  function  (or  factor)  associated  with  a  net  G(q)  with  structural  potential  V (q) 
as  follows: 

p  =  p(G(q))  =  V(q)  +  HI  W(9) ||2  >  0  (46) 

where  w  >  0  is  a  constant  weight.  We  also  define  the  normalized  defect  factor  of  G(q)  as 

Pn  =  Pn(G(q))  =  (V(q)  +  w\\VV(q)\\2)  (47) 

\^G(q)\ho 

where  \£c{q)\  denotes  the  total  number  of  edges  in  the  net  G(q)  and  ho  =  tpa{r  —  dQ).  From 
a  computational  point  of  view,  the  normalized  defect  factor  is  more  meaningful.  Since,  for  a 
large-scale  net  with  many  agents,  pn  stays  relatively  small  if  a  small  subgraph  of  the  net  is  not  a 
realization  of  the  structural  net  (da,r)  but  the  rest  of  the  net  is  a  valid  realization  of  ( da,r ). 

Any  a-net  G(q)  that  is  a  realization  of  a  structural  net  ( da,r ),  has  a  zero  defect  factor.  This  is 
due  to  the  fact  that  for  any  realization  of  (da,r),  V(q)  =  0  and  W(q)  =  0.  However,  in  presence 
of  external  forces,  cc-flocks  (or  a-nets)  do  not  usually  converge  to  a  realization  of  a  structural  net 
(■ dQ,r ).  Instead,  flocks  converge  to  what  is  rather  “close”  to  a  realization  of  (da,  r).  To  quantify  the 
quality  of  similarity  of  the  limiting  formation  of  a  flock  to  a  realization  of  (da,  r),  we  need  to  define 
the  notion  of  quasi-realizations  of  a  structural  net  ( da,r )  and  measure  its  “quality”  (in  terms  of 
satisfying  all  algebraic  inter-agent  distance-based  constraints  imposed  by  ( da,r ))  using  the  defect 
factor. 

Definition  3.  (quasi-realizations)  We  say  G(q)  induced  by  the  cluster  ( q,r )  is  a  quasi- realization 
(or  quasi- embedding)  of  the  structural  net  (da,r)  with  the  defect  factor  p  =  p(G(q)). 

In  both  limiting  cases  in  Propositions  4  and  5,  the  flock  converges  to  a  formation  (i.e.  framework 
(G(q),q))  in  which  asymptotically  the  inter-agent  distances  are  preserved  and  the  defect  factor  of 
G(q)  is  a  constant  p  =  p* .  If  this  constant  defect  factor  p*  is  zero,  then  the  flock  converges  to  a 
conformation  that  is  a  realization  of  the  structural  net  ( da,r ).  Otherwise,  it  converges  to  a  quasi¬ 
realization  of  the  structural  net  (da,r)  that  is  not  a  flexing  of  any  realization  of  (da,r)  (recall  that 
flexings  preserve  edge  length  of  frameworks  [14]). 

10  A  Separation  Principle  for  Flocking 

One  notices  that  in  both  (a,  a)-interaction  protocols  (defined  in  equations  (34)  and  (35))  satisfy 
the  property 

n 

0,  A:  =  1,2. 

i=  1 
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This  guarantees  the  invariance  of  p  =  {Y^i=iPi)/n  m  time.  Motivated  by  this  invariance  property, 
assume  that  each  a-agent  uses  the  following  protocol 

Ui  =  uf  +  u,  (48) 

with  the  property  that  Yliu?  =  0-  Let  Hs(q,p)  be  the  smooth  structural  energy  associated  with 
the  net  G(q).  We  show  that  Hs(q,p)  does  not  depend  on  the  choice  of  u. 

Following  the  line  of  construction  of  tracking  (or  navigation)  integrated  cost  functions  in  [12], 
we  define  the  translational  energy  of  the  net  (or  group)  G(q)  as 

Htr{q,P )  =  Vtr{q)  +  ^W'p-PdW2  (49) 

where  q,p  6  M2,  Vtr(q)  =  \/l  +  \\q  —  qd\\2  —  1,  and  ( qd,Pd )  denotes  a  desired  destination.  If  pa  =  0, 
we  call  this  destination  a  sink.  If  Vtr(q )  =  0,  then  pd  is  called  a  desired  group  velocity.  Our  objective 
is  to  combine  Hs  and  Htr  to  perform  both  structural  stabilization  and  tracking.  In  the  following, 
the  term  CLF  stands  for  “control  Lyapunov  function”. 

Proposition  6.  (flocking  separation  principle)  Let  H(q,p)  =  Hs(q,p)  +  Htr{q,p )  where  Hs(q,p) 
and  Htr(q,p)  are  smooth  structural  energy  and  tracking  energy  of  the  dynamic  net  ( G(q),q,p,u ) 
with  protocol  (48),  respectively.  Then,  the  following  separation  principles  hold: 

i)  Hs(q,p)  does  not  depend  on  the  choice  of  u  and  Hs(q,p)  is  a  weak  CLF  for  the  dynamic  net, 
i.e.  there  exists  a  protocol  ua  such  that  Hs(q,p )  <  0,Vt  >  0. 

ii)  Htr(q,p )  does  not  depend  on  the  choice  of  ua  and  Htr(q,p )  is  a  weak  CLF  for  the  average 
dynamics  of  the  net  for  both  cases  of  a  desired  sink  and  group  velocity,  i.e.  there  exists  a 
protocol  u  such  that  Ht.r(q,p)  <  0 ,Vt  >  0. 

Furthermore,  H(q,p)  is  a  weak  CLF  for  the  dynamic  net. 

Proof.  Please,  see  Section  A. 3  in  the  Appendix.  □ 

Remark  6.  The  proof  of  proposition  6  contains  all  the  necessary  information  regarding  the  tracking 
control  design  for  flocking. 

Let  u  =  ktr{q,p)  denote  the  translational  controller  of  the  net.  Each  a-agent  can  calculate  uf  in 
a  distributed  manner.  But  calculation  of  ktr{q,p)  (given  in  the  proof  of  Proposition  6)  requires  the 
knowledge  of  q  and  p  which  are  not  immediately  available  to  each  agent.  Either  this  information 
can  be  communicated  to  the  agent  via  a  coordinator,  or  all  agents  need  to  solve  average-consensus 
problems  [16]  in  a  distributed  fashion.  The  former  approach  is  clearly  a  centralized  algorithm 
which  is  highly  undesirable  for  flocking  due  to  its  high  communication  cost.  The  second  approach 
is  feasible  if  the  net  is  connected  (i.e.  if  the  net  is  a  flock).  In  the  following,  we  propose  a  third 
approach  that  is  distributed  and  does  not  require  the  connectivity  of  the  net. 

Suppose  each  agent  uses  the  following  protocol 

Ui  =  uf  +  fi,  f  =  -qi  -  c2Pi,  c2  >  0  (50) 

to  solve  flocking  in  the  presence  of  a  sink  at  the  origin  ( qd,Pd )  =  (0,0).  Notice  that  /)  can  be 
calculated  by  each  agent  without  any  need  for  communication  with  other  agents.  One  can  rewrite 
protocol  (50)  as 

Ui  =  uf  -  qi  -  c2pi  +  u,  (51) 
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with  the  PD  controller  u  =  —q  —  C2P ■  In  lack  of  ua  (i.e.  if  no  edges  ever  exist  between  any  two 
agents),  ut  =  —qt  —  C2Pi  and  thus  Ha(q.p)  defined  by 

Ha(q,p)  =  \\q\\2 +\\p\\2  (52) 

is  a  valid  Lyapunov  function  for  the  system  and  all  agents  will  converge  to  the  center  of  mass 
(CM)  of  the  net  at  q  =  0 ,  i.e.  (q,p)  =  0  is  globally  asymptotically  stable.  However,  if  all  agents 
converge  to  the  origin,  after  some  finite  time  T  >  0,  all  agents  enter  a  closed  ball  B(q,ro)  where 
0  <  ro  <  r/2.  Thus,  any  two  agents  become  neighbor  of  each  other  and  the  induced  net  G(q)  is 
flock  and  a  complete  undirected  graph). 

On  the  other  hand,  in  presence  of  the  (a,  a)-interaction  forces  (or  ua ) ,  convergence  of  all  the 
agents  to  the  origin  is  in  contradiction  with  reduction  of  the  structural  energy  of  the  net.  Since 
when  all  agents  coincide  V (q)  takes  its  global  maximum.  In  other  words,  in  presence  of  both  uf  and 
fi,  the  center  of  mass  of  the  flock  exponentially  converges  to  zero  and  all  agents  “try  to  converge 
to  the  CM  of  the  net”  and  “keep  a  distance  da  from  their  neighbors”.  The  tasks  in  quotes  are 
conflicting  as  described  earlier. 

Based  on  simulation  result,  we  observe  that  the  net  asymptotically  converges  to  a  flock  with  its 
CM  at  the  origin.  After  some  finite  time  T  >  0,  the  topology  of  this  flock  remains  invariant.  At 
this  point,  we  are  unable  to  prove  that  our  observation  formally  holds.  For  more  information,  see 
the  simulation  results  in  Section  11. 

11  Obstacle  Avoidance  and  Notions  of  j3- Agents  and  7- Agents 

In  this  section,  we  present  our  approach  to  multiple  fixed  obstacle  avoidance  for  a  net/flock  of 
a-agents.  We  postpone  stating  any  formal  results  regarding  multiple  obstacle  avoidance  by  groups 
of  agents  to  upcoming  papers.  But  we  provide  the  main  protocol  that  combines  the  results  from 
the  preceding  sections  on  ( a ,  a)-interaction  protocols  and  the  flocking  separation  principle  with 
obstacle  avoidance. 

For  a  net  of  a-agents  we  consider  the  task  of  moving  with  a  desired  group  velocity  pd  i=-  0  along 
the  desired  direction  =  Pd/Il/Clll  that  is  a  unit  vector  while  avoiding  collision  to  finite  number  of 
fixed  obstacles.  The  main  assumption  on  the  obstacles  is  that  they  are  convex  and  compact  sets 
and  their  boundaries  are  closed  differentiable  Jordan  curves  in  M2.  For  the  sake  of  simplicity  of 
representation  and  calculations,  we  only  treat  the  case  in  which  there  exist  m  spherical  obstacles 
(or  closed  balls)  O k  =  B ( 7 ,  lk )  for  k  =  1, ... ,  m.  We  define  the  distance  between  an  a-agent  i  and 
Ok  as  d(qi,  Ok)  =  min xeOk  \\x  —  qt\\  and  define  the  projection  of  <7*  on  the  boundary  of  Ok  as 

Qi  =  argmin xeok  I \x  -  ®  1 1  (53) 

The  existence  and  uniqueness  of  qf  is  due  to  convexity  and  compactness  properties  of  Ok- 

We  refer  to  an  agent  with  position  qf  as  a  (3-agent  provided  that  d(qt,  Ok)  <  ?’o  (Here,  we  assume 
ro  =  r/2).  In  other  words,  the  projection  of  an  a-agent  on  an  obstacle  Ok  is  called  a  (3-agent.  For 
flat  obstacles  like  walls,  this  projection  technique  is  previously  used  by  Helbing  et  al.  [7]  and  Desai 
et  al.  [4],  An  example  of  a  /3-agent  is  agent  2  in  Figure  6. 

Whenever  an  a-agent  exists  in  a  neighborhood  of  Ok,  we  refer  to  Ok  as  an  active  obstacle. 
Otherwise,  we  call  Ok  an  inactive  obstacle.  We  define  a  bipartite  graph  Kng jnj3  with  np  edges  that 
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Figure  6:  The  interaction  between  an  a-agent  (agent  1)  and  the  effect  of  an  obstacle  represented 
by  a  /3-agent  (agent  2)  and  a  7-agent  (agent  3). 

connect  each  a-agent  to  its  corresponding  /3-agent.  The  total  number  of  /3-agents  is  denoted  by  ng. 
If  all  the  obstacle  are  inactive,  or  ng  =  0,  we  set  Kn/^n;s  =  (0,0). 

In  Figure  6,  agent  3  is  called  a  7-agent.  A  7 -agent  is  an  agent  with  a  fixed  position  at  Xk  = 
bk  +  ^dnd  where  G  (0, 1]  is  a  constant.  An  a-agent  views  a  /3-agent  as  a  repelling  point  on 
the  obstacle  and  treats  a  7-agent  as  another  a-agent  that  only  exists  if  the  corresponding  /3-agent 
exists.  Both  /3  and  7  agents  associated  with  an  a-agent  Vj,  adjacent  to  an  obstacle  Ok  “disappear” 
as  soon  as  no  points  on  the  boundary  of  Ok  belongs  to  the  shell  of  node  Uj.  In  other  words,  the 
existence  of  /3-agents  and  7-agents  is  conditional. 

The  presence  of  a  7-agent  is  necessary  to  steer  an  a-agent  around  an  obstacle.  Otherwise,  an 
a-agent  Vi  might  stay  behind  or  near  a  distance  ro  from  an  obstacle  for  a  relatively  long  time 
due  to  “peer  panic”  by  other  a-agents  Vj  that  are  on  the  way  of  agent  Vi  and  hold  vi  back.  The 
role  of  a  7-agent  is  crucial  in  both  split/rejoin  maneuver  and  squeezing  maneuver.  The  latter  one 
occurs  during  the  escape  panic  phenomenon  [7],  i.e.  cases  where  many  agents  (or  vehicles)  need  to 
pass  through  a  narrow  pathway  between  two  obstacles  (or  mountains).  In  the  case  of  performing  a 
squeezing  maneuver  between  two  nearby  obstacles,  both  obstacles  might  become  active  with  respect 
to  a  single  a-agent.  In  other  words,  there  could  be  multiple  /3  and  7  agents  that  correspond  to  a 
given  a-agent. 

Let  ( qi,pi ),  ( qf,Pi ),  and  (x*,  0)  denote  the  pairs  of  (position,  velocity)  associated  with  an  a- 
agent,  /3-agent,  and  7- agent,  respectively.  Then  the  protocol  used  by  the  a-agent  can  be  expressed 
as  follows: 

ufk  =  C2,p{\\qi  -qi\\/ro)[^g{qi  -qi\\-dg)n{q^ -qi)  +  ct)1{\\xi-qi\\-d1)n{xi-qi)}+cA{p,l -pi)  (54) 

where  C3,  C4  >  0,  n(z)  =  z/H^H  for  z  ^  0,  4>g(z)  is  a  repelling  force,  and  </>7(z)  =  4>a(z).  The  velocity 
of  a  /3-agent  p\  on  the  boundary  of  obstacle  Ok  can  be  calculated  as  follows.  The  position  of  the 
/3-agent  q £  can  be  expressed  as 

Qi  =  m  +  (1  -  s)bk  (55) 


19 


with  s  =  Ik / (h  +  \\Qi  ~  Qi\\) ■  According  to  the  assumption  bk  =  0,  we  have 


Pi  =  spi  -  lk(s/s)n($  -  qi )  (56) 

where 

=  h\pj  ■  n (g  -  gi)} 

(k  +  Mi  -  qi\\)2 

Remark  7.  Apparently,  the  assumption  bk  plays  no  crucial  role  in  the  derivation  of  p\  and  can 
be  eliminated.  This  creates  the  possibility  of  dealing  with  the  case  of  multiple  moving  obstacle 
avoidance. 


(57) 


By  setting  C3  3>  1,  one  can  make  obstacle  avoidance  the  task  with  the  highest  priority.  The 
second  priority  for  an  a-agent  can  be  given  to  reaching  a  desired  group  velocity.  Finally,  the  third 
priority  can  be  given  to  keeping  a  distance  da  from  other  a-agents.  The  overall  protocol  used  by 
an  a-agent  is  given  by 

Ui  =  u\a’a’2)  +  ^2  u?k  +  utr  (58) 

Ok  active  for  i 


where  the  first  term  contains  all  (a,  a)  interaction  forces,  the  second  term  contains  all  (a,  (3)  and 
(a,  7)  interaction  forces,  and  utr  is  the  translational  controller. 

Now,  we  present  the  simulation  results  for  a  group  of  n  =  100  agents  that  use  protocol  (58). 
The  first  task  is  to  reach  a  desired  group  velocity  pd  =  (0, 10)T  and  maintain  an  inter-agent  distance 
of  da  =  7  with  r  =  1.2(4*  while  avoiding  m  =  6  obstacles  that  their  locations  and  radii  are  given 
by  the  3  x  m  matrix 
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Each  row  of  the  obstacle  matrix  M0bs  is  a  vector  ( bi,li)T  £  M2  x  M>o  that  contains  the  position 
and  radius  of  the  ith  obstacle  for  i  =  1, . . . ,  6. 

We  use  a  set  of  n  =  100  random  initial  positions  and  zero  initial  velocities  as  the  initial  condition 
of  the  net  dynamics.  The  snapshots  of  flocking  for  the  first  task  are  shown  in  Figures  7  and  8.  The 
only  difference  in  these  two  figures  is  that  the  edges  of  the  net  are  drawn  in  Figure  8  and  omitted 
in  Figure  7.  Apparently,  the  location  of  obstacles  are  chosen  such  that  split/rejoin  maneuvers  have 
to  be  performed  upon  reaching  all  obstacles.  Furthermore,  notice  that  O 5  and  0$  are  within  a 
distance  d$e  =  15  from  each  other.  Thus,  it  is  impossible  for  3  a-agents  to  pass  between  these 
two  obstacles  at  the  same  time  while  their  positions  projected  along  pd  are  equal.  This  is  due  to 
the  fact  that  2 da  +  2?’o  >  3<4*  =  21  >  15  =  d^.  Thus,  the  portion  of  the  net  that  is  vertically 
between  O 5  and  0§  needs  to  squeeze  through  the  space  between  the  two  obstacles.  This  squeezing 
maneuver  can  be  seen  in  Figures  7  and  8.  We  define  the  heading  angle  of  each  agent  as  the  angle 
of  the  agent’s  velocity  pi,  if  pi  7^  0,  and  zero  otherwise.  Based  on  Figure  8,  there  are  very  few 
agents  that  are  not  connected  to  the  most  populated  flock  and  the  density  of  the  limiting  flock  is 
approximately  equal  to  do  =  0.97  (only  3  agents  out  of  100  agents  are  not  part  of  the  main  flock). 
Clearly,  all  agents  (approximately)  move  with  the  same  velocity  and  heading  angles. 

Again,  consider  a  group  of  n  =  100  a-agents  start  from  random  initial  positions  with  zero  initial 
velocities.  The  second  task  is  to  perform  flocking  in  presence  of  a  sink  at  ( qd,Pd )  =  (0,0)  and  in 
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lack  of  any  obstacles.  Each  agent  receives  the  value  of  qd  once  at  time  t  =  0  (the  beginning  of  the 
task)  and  from  that  point  on  every  calculation  can  be  done  in  a  distributed  manner.  The  cn-agents 
need  to  maintain  an  inter-agent  distance  equal  to  da  =  7  with  r  =  1.2 da.  In  this  case,  we  expect 
that  a  net  that  is  initially  disconnected,  after  going  through  a  finite  number  of  switching  events, 
asymptotically  converges  to  a  flock  with  an  invariant  topology. 

In  general,  the  limiting  conformation  is  a  quasi-realization  of  the  structural  net  ( da,r ).  Our 
simulation  results  for  this  case  are  shown  in  Figure  9.  Apparently,  the  limiting  conformation  of  the 
net  in  this  case  is  relatively  close  to  an  embedding  of  (da,  r),  i.e.  it  has  a  relatively  low  normalized 
defect  factor.  The  final  conformation  in  this  case  happens  to  be  a  planar  graph  that  dominantly 
consists  of  equilateral  triangular  faces.  The  net  becomes  connected  after  4  seconds.  It  is  worth 
mentioning  that  the  limiting  flock  is  a  rigid  graph. 

12  Conclusion 

In  this  work,  we  provided  a  graph  theoretical  framework  that  enables  modeling  the  flocking  of 
dynamic  agents  in  presence  of  multiple  obstacles.  We  presented  formal  definitions  of  nets  and 
flocks  as  graphs  that  are  spatially  induced  by  a  set  of  node  configurations  (i.e.  clusters).  The 
realization  (or  embedding)  issues  of  structural  nets  and  flocks  were  discussed.  This  discussion 
led  to  task  representation  and  execution  for  a  network  of  agents  called  a-agents.  The  primary 
a-agent  was  to  maintain  a  certain  distance  from  other  a-agents  in  their  spatial  neighborhood  (or 
shell).  Flocking  was  defined  as  achieving  both  structural  stabilization  and  navigational  tracking. 
We  showed  that  the  first  two  flocking  rules  of  Reynolds  follow  from  the  special  cases  of  a  single 
protocol  called  the  (a,  a)  protocol.  The  third  rule  of  Reynolds  is  the  same  as  a  simple  consensus 
protocol.  In  addition,  we  discussed  certain  situations  that  are  not  accounted  for  by  Reynolds  three 
flocking  rules. 

We  also  discussed  flocking  in  the  presence  of  multiple  fixed  obstacles.  To  perform  this  task, 
two  other  types  of  agents  called  /3-agents  and  7-agents  were  introduced.  These  agents  are  located 
on  the  boundary  and  inside  of  an  obstacle.  The  existence  of  /3  and  7  agents  is  contingent  to 
the  presence  of  an  a-agent  in  a  neighborhood  of  the  corresponding  obstacle.  This  framework 
enables  us  to  address  split/rejoin  and  squeezing  maneuvers  for  nets  and  flocks  of  dynamic  agents 
that  communicate  with  each  other.  The  presence  of  obstacles  might  force  the  members  of  a  net 
(or  flock)  to  split  into  more  flocks  and  lead  to  loss  of  communication  links.  The  loss  of  existing 
links  might  lead  to  disconnectivity  of  the  network  and  change  of  the  topology  of  the  network.  In 
general,  flocking  in  presence  of  obstacles  leads  to  solving  decision  making  problems  for  agents  with 
limited  communication  in  a  network  with  switching  topology.  Analysis  of  the  protocols  for  this  case 
is  rather  challenging  and  a  number  of  problems  including  conformation  of  a  connected  network 
from  an  initially  disconnected  mobile  network  remain  open.  We  provided  simulation  results  that 
demonstrate  flocking  in  presence  of  six  obstacles  and  conformation  of  connected  networks.  The 
simulation  results  were  consistent  with  the  predictions  suggested  by  the  theoretical  results  in  our 
work. 
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A  Appendix 

In  this  appendix,  we  present  the  proof  of  some  of  the  propositions. 

A.l  Proof  of  Proposition  2 

Part  i)  We  have 

V(q)  =  0  <=>■  ipa(hj  ~  di\\  ~  da)  =  0,  Vj  G  Ni,\/i  || qj  -  %||  =  daVj  G  Nh  Vi 

which  means  q  is  a  realization  of  the  structural  net  ( da,r ). 

Part  ii)  Kr(p)  =  0  pl  =  0  for  all  i.  This  means  that  for  any  two  nodes  i  and  j,  the  distance 

\\q-j  —  qf\  is  a  constant  because 

'h  '/,  -  Qi\\2  =  ( Pj  ~  Ii)  =  ( Pj  -PiVidj  ~  Qi)  =  0. 

This  property  holds  regardless  of  whether  these  two  nodes  are  neighboring  nodes  or  not.  To 
prove  the  converse,  suppose  that  the  net  is  an  undirected  flock  (i.e.  the  graph  G(q)  is  connected) 
and  the  distance  between  any  two  nodes  is  constant  but  Kr(p )  /  0.  Thus,  there  exists  a  node 
i*  with  pi*  0.  On  the  other  hand,  the  distance  between  any  other  node  j  ^  i*  and  i*  remains 
constant  for  all  t  >  to .  Thus,  we  have 

^  u  -  <nA\2  =  ( Pj  -Pi*)T{qj  -  Qi*)  =  ( pj  -Pi*)T{qj  -  n*)  =  o. 
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But  if  ( pj  —  p^)  =  ( pj  —  pi*)  /  0,  then  pj  —  p^  cannot  be  orthogonal  to  {q-j  —  qi*)  based  on  part 
c)  of  ii).  Also,  qj  /  qi*  based  on  part  b)  of  ii).  Therefore,  fjj  =  pi*  for  all  j  /  i* .  In  other  words, 
the  relative  velocities  of  all  agents  are  equal  and  the  same  as  p*.  By  definition,  YH=iPi  =  0-  This 
implies  npi*  =  0  or  pi*  =  0  which  contradicts  the  assumption  that  pt*  ^  0  and  the  result  follows. 
Part  iii)  This  follows  from  part  ii)  and  the  fact  that  G(q(t))  remains  invariant  for  all  t  >  to  if  the 
distance  between  any  two  arbitrary  nodes  remains  invariant  for  all  t  >  to.  □ 

A. 2  Proof  of  Proposition  4 

Given  Ui  =  vi)-Q’Q,1\  we  have  22iui  =  0  and  thus  p  =  (527=1  Pi) /n  is  an  invariant  quantity,  i.e. 
p  =  0.  Define  p%  =  Pi~p  and  notice  that  22'Pi  =  0  and  pi  =  pi  =  u^.  Considering  that  the  topology 
of  the  net  is  invariant  for  all  t  6  [tk,tk+ 1),  the  (nonsmooth)  structural  energy  of  the  net  can  be 
expressed  as 


^  II  ..  IL 

H^k\q,p)  =V(q)  +  I\(p )  =  -  ^  ^  ipa{\ Wj  ~  Qi\\  ~  da)  +  -  ^  ||p*||2 

i= 1  j&Ni  i=  1 


(60) 


where  IV*  =  Ni(q(tk))  is  invariant  in  time  over  [tk,tk+ 1)  and  thus  Hsk\q,p )  is  differentiable  with 
respect  to  (q,p).  This  is  because  no  new  links  are  created  in  the  net  and  no  existing  links  are  lost 
(i.e.  no  energy  jumps  exist).  Furthermore,  if  G(q)  is  a  flock,  then  by  definition  G(q)  a  connected 
undirected  graph  satisfying  rank(L(<?))  =  n  —  1  with  n  =  |G(c/)|  where  L(q)  is  the  Laplacian 
associated  with  the  flock  G(q).  By  differentiating  Hgk\q,p)  with  respect  to  time,  we  get 


Hsk\q,p)  =  Er=l(V<7  iV(q)Pi  +  uiPi) 

=  EjeN.PliPj-Pi) 

=  d  E"=i  EjeJVi  Pi  (Pi  ~  Pi) 

=  f  E{ij)e£G(q)  Pi ( Pj  ~  Pi)  +  Pj  C Pi  ~  Pj) 
=  ~  f  52(i,j)e£Giq)  C Pj  ~  Pi)T(Pj  ~  Pi) 

=  -^J2{id)e£G(q)\\Pi-Pi\\2  <U 


which  means  Hgk\q,p)  is  a  weak  Lyapunov  function.  Now,  suppose  the  topology  of  the  net  does 
not  change  after  t  =  tm.  This  means  Hsm\q,p)  is  a  weak  Lyapunov  function  for  all  t  >  tm.  On 
the  other  hand,  H =  0  pt  =  pj  for  all  edges  (i,j)  of  the  net  G(q(tm)).  But  Grn(q(tm)) 

is  a  flock  and  thus  connected.  Therefore,  pi  =  pj  for  all  nodes  i,j,i  /  j.  Since  22iPi  =  0  and 
all  the  pp s  are  equal,  one  concludes  that  p%  =  0  for  all  i.  In  other  words,  H =  0  implies 
Pi  =  p  =  Ave(p(to ))  for  all  i.  Since  all  relative  inter-agent  velocities  are  zero,  given  H i™'*  =  0,  we 
have  til"’"’1)  =  =  0.  In  other  words,  based  on  LaSalle’s  invariance  principle,  ( q{t),p(t )) 

asymptotically  converges  to  a  relative  equilibrium  (q*  ,  p*)  with  p*  =  1  <8>p  and  q*  in  the  set  of  local 
minima  of  V(q).  Since  pi  =  0  for  all  nodes,  we  get 


d_ 

dt 


2 


Vj-Pifiqj-q*) 


(p*-p*)T(q*-q*)=0, 


and  the  length  of  all  existing  edges  are  asymptotically  invariant. 


□ 
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A. 3  Proof  of  Proposition  6 

Notice  that  q  =  p  and  p  =  u.  To  prove  i),  we  explicitly  calculate  Hs(q,p)  with  Hs(q.p)  = 
V(q)  +  \  \\Pi\\2  as  follows 

Hs{q,p)  =  W  (q)  -p  +  ^Piiui  -  u)  =  W  (q)  -p+^piuf  <  0  ,Vf  >  0  (62) 


The  last  inequality  holds  with  ua  =  u^a,a’2^  based  on  Proposition  5.  Similarly,  given  Htr(q,p)  with 
Pd  =  0  for  the  case  of  a  desired  sink,  we  obtain 

Htr{q,p )  =  VVtr(q)  ■  p  +  pr  ■  u  =  -c2pT (j){p)  <0,  c2  >  0  (63) 

with  the  bounded  state  feedback 

u  =  k£\q,p)  :=  -Wtr(q)  -  c2(j){p)  =  ~(j>{q  -  qd)  ~  c20(p)>  c2  >  0  (64) 

where  <J)(z)  =  zj y/\  +  ||z:||2  is  a  uniformly  bounded  function  (j)  :  M2  — >  M2  satisfying  zTcj)(z)  >  0  for 
all  z^O.  Clearly,  Htr(q,p)  does  not  depend  on  the  choice  of  ua  provided  that  Yhiu<i  =  0-  For  the 
case  of  a  desired  group  velocity  pd  /  0  and  Vtr{q)  =  0,  we  have  Htr(q,p )  =  \\\p  —  pd\\2  and  thus 

Htr(q,p)  =  Wtr(q)  ■  p+ (p- pd)T -u  = -c2(p- pd)T(t>{p- Pd)  <  0,  Vp  /  pd  (65) 

with  the  bounded  velocity  feedback 

u  =  h$(p)  :=  -c2<j)(p  -  pd ),  c2  >  0  (66) 

Notice  that  \\kH\q, p)\\  <  1  +  c2  and  ||£:^(p)||  <  c2.  Finally,  based  on  parts  i)  and  ii),  according  to 

H(q,p)  =  Hs(q,p)  +  Htr{q,p )  <  0 

given  that  ua  =  and  u  =  kJtr  with  j  =  1,2,  H(q(t),p(t ))  can  be  rendered  monotonically 

non-increasing  for  all  t  >  0.  □ 
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1=0  (sec) 


t=2.5  (sec) 


Figure  7:  Consecutive  snapshots  of  flocking  for  a  cluster  of  n 
obstacles  and  split/rejoin/squeezing  maneuvers. 


100 


agents  in  presence  of  m  = 
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1=0  (sec) 


t=2.5  (sec) 


Figure  8:  Consecutive  snapshots  of  flocking  for  a  net  of  n 
obstacles  and  split/rejoin/squeezing  maneuvers. 


27 


100  agents  in  presence  of  m  =  6 


t=0  (sec) 


t=0.5  (sec) 


Figure  9:  Consecutive  snapshots  of  conformation  of  a  flock  from  a  net  for  a  cluster  of  n  =  100 
agents  in  presence  of  a  sink  at  (qd,Pd)  =  (0,  0). 
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